Ensemble Filtering for High Dimensional Non-linear State Space Models
نویسندگان
چکیده
We consider non-linear state space models in high-dimensional situations, where the two common tools for state space models both have difficulties. The Kalman filter variants are seriously biased due to non-Gaussianity and the particle filter suffers from the “curse of dimensionality”. Inspired by a regression perspective on the Kalman filter, a novel approach is developed by combining the Kalman filter and particle filter, retaining the stability of the Kalman filter in large systems as well as the accuracy of particle filters in highly non-linear systems. Its theoretical properties are justified under the Gaussian linear models as an extension of the Kalman filter. Its performance is tested and compared with other methods on a simulated chaotic system which is used widely in numerical weather forecasting.
منابع مشابه
Toward a nonlinear ensemble filter for high dimensional systems
Many geophysical problems are characterized by high-dimensional, nonlinear systems and pose difficult challenges for real-time data assimilation (updating) and forecasting. The present work builds on the ensemble Kalman filter (EnsKF) with the goal of producing ensemble filtering techniques applicable to non-Gaussian densities and high-dimensional systems. Three filtering algorithms based on re...
متن کاملNon-Gaussian Test Models for Prediction and State Estimation with Model Errors
Turbulent dynamical systems involve dynamics with both a large dimensional phase space and a large number of positive Lyapunov exponents. Such systems are ubiquitous in applications in contemporary science and engineering where statistical ensemble prediction and real-time filtering/state estimation are needed despite the underlying complexity of the system. Statistically exactly solvable test ...
متن کاملA nonlinear filter that extends to high dimensional systems
Numerical weather prediction is characterized by high-dimensional, nonlinear systems and poses difficult challenges for real-time data assimilation (updating) and forecasting. The goal of this work is to build on the ensemble Kalman filter (EnsKF) to produce ensemble filtering techniques applicable to non-Gaussian densities in high dimensions. Two filtering algorithms are presented which extend...
متن کاملModeling and prediction of environmental data in space and time using Kalman filtering
The Kalman filter is used in this paper as a framework for space time data analysis. Using Kalman filtering it is possible to include physically based simulation models into the data analysis procedure. Attention is concentrated on the development of fast filter algorithms to make Kalman filtering feasible for high dimensional space time models. The ensemble Kalman filter and the reduced rank s...
متن کاملAn Improved Data Assimilation Scheme for High Dimensional Nonlinear Systems
Nonlinear/non-Gaussian filtering has broad applications in many areas of life sciences where either the dynamic is nonlinear and/or the probability density function of uncertain state is non-Gaussian. In such problems, the accuracy of the estimated quantities depends highly upon how accurately their posterior pdf can be approximated. In low dimensional state spaces, methods based on Sequential ...
متن کامل